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AMENDMENTS TO THE CLAIMS 

Please add or amend the claims to read as follows, and cancel without prejudice or 
disclaimer to resubmission in a divisional or continuation application claims indicated as 
cancelled: 

1. (Original) A method of selecting key-frames from a video sequence to produce a subset 
of key-frames for indexing, archiving, browsing and/or searching purposes, comprising 
the following steps: 

(a) producing an initial set of frames from said video sequence; 

(b) introducing each frame of said initial set sequentially into a 3 -frame 
buffer to include a middle frame M, its preceding frame L, and its 
succeeding frame R; 

(c) testing for redundancy each M frame with respect to its preceding L 
frame and its succeeding R frame; and 

(d) selecting as a key-frame for inclusion in the subset those M frames tested 
to be non-redundant. 

2. (Previously Presented) The method according to claim 1, wherein each M frame is 
tested for redundancy, with respect to its preceding L frame and its succeeding R frame, 
by: 

representing the M frame as a combination of geometric transformations applied 
to selected regions in the L and R frames; 

subtracting the geometric transformation of the L and R frames from the M frame 
to produce difference images; and 

determining from the difference images whether or note the M frame is redundant. 
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3. (Previously Presented) The method according to claim 1, wherein each M frame is 
tested for redundancy, with respect to its preceding L frame and its succeeding R frame, 
by: 

iteratively identifying motion entities having relative motion between the M 
frame, its preceding L frame, and its succeeding R frame; 

utilizing the identified motion entities for identifying regions in the M frame that 
can be transformed from the L and R frames into the M frame; 

transforming said identified regions in the M frame to the corresponding regions in 
the L and R frames; 

measuring the difference between said identified regions and said 
corresponding transformed regions in the M frame to produce difference images; 

measuring the areas of said difference images by counting the number of 
pixels of an intensity value above a predetermined threshold; and 

discarding the M frame when said measured areas are less than a prespecified area 
threshold. 

4. (Original) The method according to claim 1, wherein: 

some of the frames in the initial set include overlay ed frames having graphic 
overlays superimposed on live video content, and non-overlayed frames having only live 
video content; 

before step (c), a mask is produced of the graphic overlay in each overlayed frame 
and is utilized to remove the graphic overlay from the live video content in the respective 
overlayed frame; 
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step (c) tests for redundancy the live video content in both the overlayed frames 
and the non-overlayed frames; and 

step (d) discards those M frames tested to be redundant in both the overlayed 
frames and the non-overlayed frames, such that a subset of key-frames is produced 
based on live video content in the overlayed frames and the non-overiayed frames in the 
initial set. 

5. (Original) The method according to claim 4, wherein at least one overiayed 
frame is selected as an overlay key-frame and is merged with the subset of 
key-frames produced based on live video content. 

6. (Previously Presented) The method according to claim 1, wherein at least some of said 
frames in the initial set include frames containing an image of a predetermined object 
and wherein at least one such image frame is used for selecting a key-frame for 
inclusion in the subset. 

7. (Original) The method according to claim 6, wherein said at least one image frame is 
used for selecting as a key-frame by: 

detecting at least one such image in a frame in the initial set; 
tracking said at least one image through the video sequence to produce a series of 
image frames; 

computing at least one image-based metric for said image from said series of 
image frames; and 

selecting a key-frame from said series of image frames based on said at least one 
image-based metric. 
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8. (Original) A method according to claim 7, wherein said at least one image-based metric 
includes an image self-similarity index and is used to select a plurality of interim key- 
frames. 

9. (Original) The method according to claim 8, wherein an image quality index is applied 
to said interim key-frames to select a key-frame for inclusion in said subset. 

10. (Original) The method according to claim 1 ? wherein said initial set of frames is the 
entire video sequence. 

11. (Original) The method according to claim 1, wherein said initial set of frames is 
produced by selecting every nth frame from the video sequence where n is greater than 
1. 

12 (Original) The method according to claim 1, wherein said initial set of frames is 
produced by selecting frames from the video sequence based on a distance 
metric between frames. 

13. (Cancelled) 

14. (Previously Presented) A method of selecting key-frames from an initial set of 
frames to produce a subset of key-frames for indexing, archiving, browsing and / 
or searching purposes, comprising: testing for redundancy each frame of the initial set 
with respect to at least its preceding frame by: 

representing the tested frame as a combination of geometric transformations 
applied to selected regions in the preceding frame; 

subtracting the geometric transformation of the preceding frame from the tested 
frame to produce difference images; and 
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determining from the difference images whether or not the tested frame is 
redundant, wherein said redundancy test is made by: 

iteratively identifying motion entities having relative motion between the tested 
frame and its preceding frame; 

utilizing the identified motion entities for identifying regions in the tested frame 
that can be transformed from the preceding frame into the tested frame; 

transforming said identified regions in the tested frame to the corresponding 
regions in the preceding frame; 

measuring the differences between said identified regions and said 
corresponding transformed regions in the tested frames to produce difference images; 

measuring the areas of the difference images by counting the number of 
pixels of an intensity value above a predetermined threshold; and 

discarding the tested frame when said measured areas are less than a 
prespecified area threshold. 

15. (Original) The method according to claim 14, wherein each frame is tested for 
redundancy also with respect to its succeeding frame in the initial set of frames 
and is discarded if redundancy is found in either the succeeding frame or in the 
preceding frame. 

16. (Cancelled) 

17. (Previously Presented) A method of selecting key-frames from a video sequence,, 
which includes overlayed frames having graphic overlays superimposed on live 
video content, and non-overlayed frames having only live video content, said 
method comprising: 
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masking out from said overlayed frames the superimposed graphic 
overlays; 

testing for redundancy the live video content of neighboring overlayed 
frames and non-overlayed frames; 

selecting as key-frames the overlayed frames and non-overlayed frames 
whose live video contents were tested to be non-redundant, 

selecting at least one overlayed frame as an overlay key-frame; and 

merging each selected overlay key-frame with the key-frames selected 
on live video content. 

18. (Cancelled) 

19. (Previously Presented) A method of selecting key-frames from a video 
sequence for inclusion in a subset of key-frames, comprising: 

detecting at least one predetermined image in the video sequence; 

tracking said at least one image through the video sequence to produce a 
series of image frames; 

computing at least one image-based metric for said image from said series 
of image frames; and 

selecting a key-frame from said series of image frames based on said at 
least one image- based metric, wherein said at least one image-based metric includes 
an image self-similarity index and is used to select a plurality of interim key-frames. 

20. (Original) The method according to claim 19, wherein an image-quality index is applied 
to said interim key-frames to select a key- frame for inclusion in said subset 
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21. (Previously Presented) The method according to claim 19, wherein said 
predetermined image is a face, graphic or other object image. 

22. (Cancelled) 

23. (Previously Presented) A method of selecting key-frames from a video sequence, 
comprising: 

selecting one subset of key- frames which represent at least one feature of the 
video sequence; 

selecting at least one other subset of key-frames which represent at least one 
other feature of the video sequence; and 

combining said at least two subsets of key-frames to produce a combined set of 
key-frames, wherein said combining of the at least two subsets of key-frame comprises 
merging said subsets of key-frames to produce said combined set of key-frames; 

testing pairs of adjacent key-frames in said combined set of key-frames for 
redundancy; and 

discarding one of the pair of adjacent key-frames where redundancy is found 
to be present in a tested pair. 

24. (Original) A method as claimed in claim 23, where said combined set of key- 
frames includes a subset of key-frames selected on the basis of live video content. 

25. (Original) The method as claimed in claim 24, where said combined set of key- 
frames includes a subset of key-frames selected on the basis of graphic overlays. 

26. (Original) The method as claimed in claim 24, where said combined set of key- 
frames includes a subset of key-frames selected on the basis of face content. 
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27. (Original) The method according to claim 24, wherein the key-frame of a pair which is 
discarded when redundancy is found to be present is the key-frame of the pair found to 
have the lower quality index with respect to said live video content. 

28. (Currently Amended) A method of processing a video sequence of frames 
including graphic overlayed frames having a graphic overlay super imposed on live- 
video content, comprising: 

detecting regions of the graphic overlay in said sequence; 
generating a mask image of said graphics overlay; mid 

utilizing said mask image for separating said graphics overlay from at least 
one overlayed frame in the sequence for also generating thereby a live video content 
image in addition to said mask image ; and 

selecting at least one key frame from said video sequence based on analysis of 
said live video content . 

29. (Cancelled) 

30. (Original) The method according to claim 28, wherein said mask image is used for 
selecting a graphic overlay key-frame from said video sequence. 

31-32.(Cancelled) 

33. (Currently Amended) A method of selecting key-frames from a video sequence 
for inclusion in a subset, comprising: 

detecting at least two frames in the video sequence having a 
predetermined face image; 

applying an image-quality metric to said detected frames; and 
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selecting as a key-frame, for inclusion in said subset, the detected 
frame having the higher image-quality metric , further comprising; 

applying prior to said step of applying an image-quality metric an image- 
similarity metric to select a plurality of interim key-frames; and 

applying the image-quality metric to said interim key-frames to select the key- 
frame to be included in said subset. 



